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ABSTRACT 

This Study focused on tha Instructors-Group 
Interaction Scale, formulated by Hildebrand, Wilson, and Dienst 
(1971), to explore the feasibility and usefulness of an instrument 
for recording instructor--group interaction in the college classroom. 
It was hypothesized that data from the scale would (a) provide the 
instructor with the pattern of classroom interaction; (b) explore the 
relationship between an observer's categorizing of interaction and 
the students' evaluation of the interaction; anc (c) determine the 
correlation between the students' evaluation of the instructor's 
interaction and the overall evaluation of theinstructor. Three 
professors were observed in a tiotal of eight sessions • Their verbal 
patterns were assessed every 3 seconds on a 17 category observation 
form. The data compiled from this form were placed in eight matrixes 
which were presented in the apjpendix. The student evaluation form 
consisted of 36 items v^ich ranked on a seven point scale. The 
results revealed that the matrix was a valuable instrument for some 
professors but a refinement of the 17 categories was indicated. 
Analysis of the student evaluation form offered only tentative 
conclusions. Four tables of statistical data v/ere presented. (BRB) 
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Several studies have been done iii>ecent years to identify the characteristics ^S^^S-gSgS 

_ of good teaching at the College level. Thlstlethwaite {I960) found differences among §l§|S;-:il 

r-- teachers in different major fields with respect to the characteristics students felt fI-IEP^;^ 

Q contributed most to their desire to learn. (Feldman and Newcomb,p. 273). Riley, Ryan S^lgSg 

and Lifshitz (1050) in a survey of the student body at Brooklyn College found the qualities 

thought essential for effective instruction varied considerably with the discipline. Solomon 

(1966) in a study of teacher behavioral qualities notes 

. . • of teacher behavior have not yet discovered a stable and consistent 
set of behavorial dimensions, patterns, or styles to relate to the effective 
promotion of learning. While certain similarities and convergences can 
be found. . . inconclusive and contradictory results are still more typical, 
(in Magoon, A.J. and J.R. Price. "Rating Dimensions of Course and 
Instruction Characteristics: The Eye of the Beholder", 1972). 

The Magoon and Price study (1972) suggests that student evaluation of instructors reflect 

students^ organization of attributes rather than raters' perceptions of a course or instructor. 

Their hypothesis emerged from an analysis of the pattern of deviation about tho mean, 

patterns too clearly defined to attribute to error. 

The exploratory study described in this paper is the outcome of reflection on the 

Hildebrand, Wilson and Dienst (1971) research identifying the components of effective 

teaching at t^e University level, and the body of research on instructor-group interaction, 

M ' 

^ Withall(1949, Flanders (1960), Furst.(1565), Hough and Ober (1966). Hildebrand, Wilson 
and Dienst surveyed n^ore than 1600 students and faculty over a three year period, asking 
students to describe the tea iiing of those identified by them as the best teachers and z.^ 



the worst teachers, and asking faculty to identify a best and a worst teacher among their 
colleagues. A foilow-up validation study was done a year later with 1015 respondents 
answering questions about the teaching of a given instructor, liie classes todjuded 
those of instructors identified as best , as worst and not previously identified as either 
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in the earlier survey. The study indicated high agreement among the student groups and 
between the students and the faculty about the effectiveness of teaching. Unlike the 
Thistlethvvaite and the Riley, Ryan and Lifshitz studies, the Hildebrand, Wilson and 
Dienst study identified characteristics common to best teachers in all disciplines. 

Scales characterizing effective teaching as perceived by students were established 
by factor analysis. These included Analytic Syrnthetic Approach, Organization and CJarity, 
Instructor-Group Interaction, Instructor-Individual Student Interaction, and Dynamism 
and Enthusiasm. 

Scale 1. Analytic Synthetic approach- relates to scholarship, with emphasis 
on breadth, analytic ability, and conceptual understanding. 

Scale 2. Organization/Clarity- relates to skill at presentation, but is subject 

related, not student related, and not concerned merely with rhetorical 
skill. 

Scale 3. Instructor-Group Interaction- relates to rapport with class as a whole, 

sensitivity to class response, and skill at securing active class participation. 

Scale 4. Instructor -Individual Stuo'^int Interaction- relates to mutual respect and 
rapport between the instructor and the individual student. 

Scale 5. Dynamism/ Enthusiasm- relatos to flair and infectious enthusiasm 

. Uikt '^omes with confidence, e:fcitement for the subject, and pleasure 
in teaching. 

(Hildebr'^iid, Wilson, Dienst, p. 18) 
The study described here focused on the Inatruotor- Group Interaction scale to 
explore the feasibility and the usefulness of sn instrument for recording instructor- 
group interaction in the college classroom to provide the instructor with date on the 
pattern of classroom iiiteraction; to explore tiie relationship between an observer's 
categorizing of interaction and the students' evaluation of the interaction; and to 
determine whether there is a correlation between the students' evaluation of the 
inscructor's interaction and their overall evaluation of the inetruotor. 



Procedure 

Flanders' Jateraction Analysis categories were supplemented with seven 
components from the Hildebrand, Wilson, Dienst Scale 3, Instructor- Group Inter- 
action* Only those components which could be demonstrated verbally were used, thu/i 
category 21, ''has interest and concern in the quality of his teaching", was omitted. 
The observation form consisted of the following seventeen categories: 

1. Accepts feelings 

2. Praises or encourages 

3. Accepts or uses ideas of students 

4. Asks questions 

' * * ^ 5. Lecturing ' 

6. Giving directions 

7. Criticizing or justifying authority 

8. Student talk-limited 
9/ Student talk- divergent 
10. Silence or confusion 

11* Encourages class discussion 

12. Invites students to share knowledge or experiences 

13. Clarifies thinking by identifying reasons fox' questions 

14. Invites criticism of his own ideas 

15. Indicates awareness that class is confused 
. id. Indicates awareness that class is bored 
Yl. Has students apply concepts to demonstrave understanding 



Categories 1-10 are Flanders, categories U-l? are adapted from Hildebrand, Wilson 
,and Dienst. 

This instrument was used to assess the Instructor- Group interaction by recording 
every tliree seconds the number of the category that beet deaoribed tho verbal pattern 
at that moment. Three Rosemont College Professors were observed in a total of 8 
class sessions, four of one Professor, three of a second Professor, amd one of a third 
Professor. A matrix was constructed to illustrate the recorded data and to summarize 
the patterns of interaction. Table I. 

A student evaluation form drawn from the Hildebrand study consisting of 36 items 
to be ranked on a 7 point scale was administered to the students in the classes where 
the observer recoz^ded the interaction. Appendix A. This was a modification of the 
Berkeley medium length form (Hildebrand, Wilson, Dienst, p. 40) and included items 
11-17 from the observation form, as well as 7 components of effective teaching from 
each of the other 4 scales, Analytic-Synthetic Approach, Organization and Clarity, 
Instructor-Individual Student Interaction, and DjTiamism/Enthusiasm. These were tabulated, 
a mean for each scale for each professor was calculated , as well as a total mean on the 
C ^ items. Tlie mean of the Interaction -Group Scale (3) for each professor was compared 
with his overall mean and with the highest mean of his five scales. 

The print out of the observation matrices were discussed with the professors 
to ascertain the value of this recording of interaction data to the individual professor. 
Results 

Matrices A-1, A-2, A-3, A-4, in Table I, show the pattern of interaction in the 
four classes observed of Professor A. A color system has been devised and uf;ed to 
simplify interpretation of the matrix so the instructor can read the significant facts with 
a minimum of instruction* 



Color key: 

Orange- The cells with orange shading indicate extended use of the same category, 
for example, long periods of lecture, 5-5, long questioning, 4-4, long student 
divergent response 9-9. All other cells are transition cells; they indicate the 
beginni:ig or ending of particular student or instructor behavior. 
Yellow- These cells indicate the instructor response to student statements. A 
10 in the cell of the 9lh row, 3rd column, indicates that in 10 instances the instructor 
followed a student statement with acceptance of student ideas. 
Green - These cells indicate the verbal behaviors that led out of lecture. 
Purj2le7 These cells indicate the verbal behaviors that led into lecture. 
Blue- These cells indicate the behavior that preceded student participation. 
Red - Boxed Area - This is an area of instructor-group interaction, a combination 
of encouragement of discussion, student response and silence. 
In Matrices A-l,A-2, A-3 and A-4, che primary pattern starts in cell 5-5, 
steady state of lecture, 5-4 lecture to question, 4-4 continued development of the 
question, and then 4-9, student divergent reponse to the question, or, as in Matrix 
A-4, 4-10, a period of silence after the question. The student response is generally 
extended, 9- 9, and follov* ed by 9-3, acceptance of student ideas, or, as in A-3, 
9-5, back into the pattern of lecture. When student response is followed by acceptance 
of stuav.*it ideas, 9-3, as in ^-1, A-2, and A-4, this is extended in the 3-3 cell in 
Matrices A-1 and A-2 and followed by 3-5, a movfr into lecture. Some interpreters 
consider a cell signii'icant for identifying a patt^^rn, only if it has 10% or more of the 



total tallies. If this rule is applied to Matrices A-1, A-2,A-'3 and A-4, the only 
' significant pattern is lecture, 5-5. 

• Matrices B-1, B-2 and B-3 show the pattern of interaction observed in the 
classes of Professor B. .The predominant pattern is lecture 5-5, with questions 
leading out of lecture, 5-4, these questions are usually extended, 4-4, and 
followed by student limited response, 4-8. On Matrices B-2 and B-3, the student 
response is usually followed by acceptance of student ideaSj, while on Matrix 
B-1, the more significant pattern is student divergent respozise 4-9, which is 
extended, 9-9, and followed by further questions from the in£;tinxctor or praise 
and encouragement. If the 10% rule is applied to Matrices B-1, B-2 and B-3, 
the only significant pattern is lecture. 

Matric C-1 shows the pattern of interaction csbserved in ^he class of Professor 
C. It illustrates two patterns, one, lecture, 5-5, the other, an interaction in the 
9-9, 9-10, 10-9, cells. This illustrates a pattern of student discussion. A tally 
was made in the 10 cell each time a student speaker changed. The 10t^9 cell with 
50 tallies and the 9-10 cell with 41 tallies can be interpreted as an estimate of 
the student-student dynamic. The instructor's. role a^ this time is seen in the 
9-2 cell, praise and encouragement, with 57 instances of this which generally 
led into further student discussion, 2-S cell, with 40 instances. C-1 is a distinctly 
different pattern of instructor-group interaction with 41% of the time in lecture and 
44% of the time in student discussion. Because it was not possible to obti ln more 
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than one observation for this instinictor, the instinictor was asked whether each 
' of his classes usually had a period of student discussion and a period of lecture. 
The Instructor said this is the way he plans his work. 

Table II is a comparioson of the three professors on the proportion of class time 
spent in each of the 17 verbal behavior categories. 

The Matrices for Inatructor A and for Inatructor C were reviewed with the 
Instructors to determine whether the recording of the interaction dynamic was 
of any value to the instructor to analyze his teaching. In both instances the 
iQstructors found in the matrices elements of interest and of surprise. Instructor 
A expressed distress at the high percentage of lecture and the minimal use of 
categories 11-17. He commented that if these categories were significant components 
of good teaching at the college level, that the hours spent in preparation for a class 
would focus less on getting on top of the material than on how to present the material 
using these categories. He found the information in the matrix more valuable than 
the evaluative instruments his students have used in the past. He raised a question 
about category 16- recognizes class is bored- how it would be manifested verbally. 

Instructor C whose matrix showed 41% lecture, 44% student talk, was surprised 
at what he considered a high percentage for lecture. He was surprised and encouraged 
with the 9-10, 10-9 dynamic, and pointed to the need for a sociogx^am or other instru- 
ment to determine the pattern of student interaction. He expressed concern with 
having 'struck out' in category 14- invites criticism of his own Ideaa 
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The second step of the study was to determine what evaluation the students 
^ give to each professor on the five evaluation scales in. order to explore the re- 
lationship between the matrices and the students' evaluation; and to determine 
whether there is a difforenoe between the atudonts' evaluation of the Inatruotor's 
interaction and the composite evaluation of the five scales. The evaluation form 
in Appendix A was used. 

27 students responded in Professor A's classes, 16 in Professor B's classes 
and 8 in Professor C's classes. The number of students responding is lower than 
expected and desired, but could not be controlled because the forms were not 
available until after all Seniors were no longer attedning class. 

.Means for each item were calculated, Table III, and averaged to determine a 
grand mean.. The items were put into the five scales. Table IV, and means for each 
scale calculated. A t test was used to test the significance of the difference between 
the mean for the Group- Interaction Scale (3) and the grand mean for each instructor. 
These differences, were not signif-jcant. A t test was used to test the significance 
of the difference between the mean of each instructor's lowest scale, which for 
instructors -and B was the Group interaction Scale (3) and the mean of the instructors 
highest scale, which for both instructors A and B was Dynamism/Enthusiasm (5). 
For both instructor A and Instructor B the difference in means for the highest and 
lowest scale on tJ^e student eraluation is significant at the . 05 level. Table V. There 
is no sig-nificaat difference between any of the means of the scales lor instructor C, 
nor is there a significant difference between his mean on Scale 3 and that of instructor 
A. 
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Discussion and Conclusions 

This limited exposure of the matrix in the college classroom indicates that 
an instrument is of value at this level for some instructors. The matriK needs 
more exposure with a diversity of instructors and subject matter to test out and 
refine the 17 category system. This brief use has indicated that a break down of 
the lecture category migth be beneficial - a break down that would distinguish 
giving of information from examples or illustrations. As Professor A pointed 
out Category 16- recognizes class is bored- would be more likely a non-verbal 
shift , tlian an articulation that would be recorded asv verbal behavior. Hence, 
16 should probably be eliminated. 

This study suggests that one observation is an adequate representation of the 
usual teaching style of a given instructor and that unless there were conditions 
in each course that elicited significantly different verbal patterns , an initial 
single observation would provide enough data for an instructor to analyze the 
verbal patterns in his classes. This could be followed up if the professor wanted 
to see whether he had successfully modified a particular pattern or patterns. 

The analysis of the student evaluation forms leads to several tiintative conculsions 

1. Sfaident evaluation forms are less valuable for analyzing axxd improving 
teachiDij than an instrument wluch objectively records the teaching process. 

2. Student evaluation forms reveal little discrimination of the degree to vhich 
an instructor demonstrates various components of teaching witiiin scales and between 
scales. This evidence lead^ me to support the thesis of Magoon and Price that 
students have preconceived notions of what characteristics of courses and instructors 
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correlate, and which do not. (Magoon and Price, Paper presented at American 
Educational Research Association, April, 1972, p. 4) 

3. The significance of the difference between the mean of the highest scale 
and the mean of the lowest scale for both Instructors A and B is Imporcont; It Is 
the only indication that the student evaluation concurs with the objective evidence 
of the matrix. Though neither instructor was rated below average on Instructor- 
Group Interaction, both groups of students do evaluate the D>D.amism/ Enthusiasm 
significantly higher. The fact that there are no significant differences in the means 
of the five scales for Professor C supports this to some extent. His evaluation is 
quite even. 

4. The non-discriminatory nature of the student evaluations is also supported 
in Professor C'fe very even evaluation. Though the matrix indicates a very high 
percentage of student talk and student interaction, which, I would hypothesize, is 
unusual on this campus, these students have not identified that as exceptional. 
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Table II- Comparison of Matrices of Professors A, B, C 

CATEGORY PROPORTION OF TIME OBSERVED 

ABC 



1. Accepts feelings 


.07% 


. 13% 


. 7 


£tm i-Taiscs or encourages 


• Uo 


e 
• D 


Q A 
O. 4 


3. Accepts or uses ideas of students 


o 


• 8 


O A 

2. 0 


4. Asks questions 






9 9 


5, Lectures 


OA A C 

o4. 45 




A'\ f1 

4J. 7 


6. Giving Directions 




U 


A 
U 


7. Criticizing or justifying anther ily 


0 


0 


0 


8* Student talk-limited 


.33 


1.4 


.1 


9. Student talk-divergent 


ft A 

7. 0 


o. 1 


A A O 

44. 0 


10. Silence or confusion 


1.93 


1. 87 


3.9 


IL Encourages class discussion 


1. 1 


.13 


. 5 


12. Invites students to share knowledge or 
experience 


0 


0 


.1 


13. Clarifies chinking by identifying reason 
for question 


1.28 


.13 


.4 


14; Invites criticism of his own ideas 


.13 


, 0 


0 


15. Indicates awareness that class is confused 


.2 


0 


.1 


16. Indicates awareness that class is bored 


0 


0 


0 


17. Has students apply concepts to demonstrate 
understanding 


.08 


0 


0 
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STUDENT EVALUATION FORM- MEAN FOR EACH ITEM 



ITEM 






y« — n f7 


A 


0»*±0 


2 




3 


*t« o 


4 




5 


o« xo 


6 




7 




8 


5 0 


9 




10 




11 


4. 7 


12 


4. 35 


13 


4. 6 


14 


5 4 


15 


5. 5 


16 


5. 5 


17 


5. 15 


18 


4 9 


19 


5 55 


20 




21 


R ^R 


22 




23 


A Q 


24 


R Q 


25 


)• v 




A 7 


97 


4. 7 


28 


4.9^ 


29 


5j' 


30 


5/4 


31 


5.6 


32 


5.8 


33 


5.4 


34 


4.8 


35 


6.0 


36 


6.0 



Meaii= 5.4 



Professor B Professor C 

n=16 n=8 



5. 75 


6. 0 


6. 25 


5.25 


5. 3 


6. 37 


6. 69 


5. 0 


6.44 


5. 5V 


0. 0 


1/. D 


C Q 
0. O 


0. o2 




/? O Q 

0. oo 


0. bo 


D. 7d 


0. ZD 


4. OO 


0. ou 


D. oo 


0* io 


4. 11 


D. Do 


D. io 


D. Do 


A 

4. /D 


0. OZ 


0. U 


0. D 


D. ZD 


0. iZ 


4. oo 


D. 6 


5. 38. 


0. D 


6. 0 


6. 88 


6. 5 


6. 18 


5. 38 


6. 56 


6. 0 


5. 87 


5. 63 


6. 25 


5. 38 


6. 69 


5.88 


5.69 


4.25 


6.18 


4. 63 


5. 74 


4. 88 


5.87 


4. 13 


5.75 


5. 57 


6. 13 


5.25 


6. 69 


5.87 


6.06 


4. 33 


4. 94 


5. 0 


6. 56. 


5. 12 


6.8 


5.25 



6.14 5.38 



TABLE IV STUDENT EVALUATION ITEMS IN FIVE SCALES 







irToiessor /v 


xToiessor jd 


xToxeDDor V/ 


I. 


Analytic Synthetic 










1 


5. 45 


5.75 


6.0 




a 
\j 






Q. O 




11 


A 7 


O. / 


0. 4 




la 




/IK 

b# 0 


0. o 




91 


0* OO 


b* Z 


0. 4 








0. 7 


A O 

4. o 






C /I 

0# 4: 


0. 8 


0. 6 




Meajis— 




0. 94 


0. 36 


2. 


Organization /Clarity 










2 


4.8 


6.3 


5.25 




1 


£)• bo 


6. 8 


6. 62 






A OK 


6*2 


A nl 

4. 71 




T7 


0* io 


6.1 


A O O 

4. 88 




o o 


0. 45 


6. 6 


6. 0 




27 


4. 7 


6.2 


4. 63 




6i 


o, b 


6.1 


0. 25 




Meaiis= 


C Aft 

0. Ul) 


6. 32 


5. 34 


3. 


Instructor Group Interaction 










o 
6 


yl Q 


0. o 


c on 




o 


O* U 


O. i7 


0. OO 




13 


4.6 


5.5 


5. 13 




18 


4.9 


5.3 


5. 38 




23 


4.9 


O. i7 


O. OO 




28 


4.9 


O. D 


fx. OO 




32* 


5. 85 * 


A 7 * 


O. O 1 ^ 




34 


4.8 




o. u 




Means= 


4. 84 


0. *JkO 


O. 04 




*Item 32 omitted from 










. means 








4. 


Instructor Sidividual Interaction 








4 


5. 65 


6.7 


5.0 




9 


6.05 


6.6 


5.8 




14 


5.4 


5.6 


4.8 




19 


5. 55 


6.5 


6.0 




24 


5.9 


6.3 


5.4 




29 


5.1 


. 5.9 


4.1 




35 


6.0 


6.6 


5.1 




Means= 


5. 66 


6. 31 


6.17 



TABLE IV STUDENT EVALUATION ITEMS IN FIVE SCALES (cont. ) 
Scale Item Professor A Professor B Professor C 

5. Dynamism/ Enthusiasm 
5 
10 
15 
20 
25 
33 

36 

Means= 



5. 15 


6.4 


5. 57 


5.3 


6.3 


4.86 


5,5 


6.6 


6.0 


5. 65 


6.9 


6.5 


6.0 


6.7 


5.9 


5.4 


6.1 


4.3 


6.0 


6.8 


5.3 


5. 57 


6.54 


5.5 
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TABLE V COMPARISON OF MEANS OF HIGHEST SCALE WITH LOWEST 
FOR PROFESSOR A AND B 



Professor A 

Interaction Scale Enthu8ia8m/i:)ynami8m Scale 

4.8 .0016 5.15 .176 
■5.0 .0256 5.3 .073 
4.6 .0576 5.5 .02 

4.9 i=0036 5.65 .0035 
4.9 .0036 6.0 .1877 
4.9 .0036 5.4 .0003 
4.8 .0016 6.0 .1877 

]V^ean= 4. 84 Mean = 5. 57 . 

s = . 0138 8 = . 0926 



t= 2. 239 
df = 12 

t is significant at . 05 level 

Professor B 



Interaction Scale 



5. 3 . 0324 

5. 9 . 176 
5. 5 .0004 

5. 3 . -032 

5. 9 . 176 

5. 6 . 0144 

4.9 .336 



Mean = 5. 48 
s =. 1096 



Enthusia8m /Dynami8m Scale 

6.4 .0676 

6. 3 . 0196 

6. 6 . 0576 

6. 9 .0036 

6.7 .1296 

6. 1 . 0256 

6. 8 . 1936 

Mean = 6. 54 
8^= . 0796 



t = 2. 49 
df=12 

t is significant at . 05 level 



